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This was a study to see whether students learn 
specific material better in classes which emphasize recitation on 
fact questions or recitation which involves the students in higher 
cognitive reasoning and interpreting skills. A series of 10 one-hour 
ecology lessons were taught by specially trained teachers; the same 
curriculum materials were presented to four treatments groups. In one 
treatment group, teachers asked guestions divided into 25 percent 
higher cognitive- questions (HCQ's) and 75 percnet fact questions. 
Group 2 asked 50 percent of each kind of question. Grpup 3 used 75 
percent HCQ's and 25 percent fact questions. Group 4 used no 
recitation, but involved the students in art activities on ecological 
themes. Students were examined before and after the course with tests 
that included multiple^choice, essay, and oral questions. Results are 
not to be generalized too broadly because recitation . .gxoups were 
unusually small (6 students) and teachers were taught to present 
rigid recitation plans. Results showed however, that the students in. 
the 25 percent HCQ sample did slightly better on fact questions and 
about as well on reasoning guestions as students in other groups. 
This indicated that having students recite facts may prompt their 
learning more effectively than has been supposed recently. The 50 
percent HCQ sample did relatively poorly on facts, but out-performed 
the other groups on cognitive questions. The art group did not excel 
in either kind of test. (CD) 



ED 115 598 

AUTHOR 
TITLE 
PUB DATE 
NOTE 



AVAILABLE FF.OH 



EDRS PRICE 
DESCRIPTORS 



ABSTRACT 



********* **************************** ********************************** 

* Documents acquired by ERIC include many informal unpublished * 

* materials not available from other sources. ERIC makes every effort * 

* to obtain the best copy available. Nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the quality * 

* of the microfiche and hardcopy reproductions ERIC makes available * 

* via the ERIC Document Reproduction Service (EDRS). EDRS is not 

* responsible for the quality of the original document. Reproductions * 

* supplied by EDRS are the best that can be made from the original. * 
*********************************************************************** 



ERIC 



Effects of Teaching by Recitation on Learning 



Meredith D. Gall , David C. Berliner, Leonard A. Cahen, 
Kenneth A. Crown, Beatrice A. Ward 
Far West Laboratory for Educational Research and Development 



and 



2 

George C. Stanton and Philip Winne 
Stanford Center for Research and Development in Teaching 



Paper presented at the annual meeting of the 



American Psychological Association, 
Chicago, September 1975 



C i 



U S.OEPAHTMENTOF HEALTH, 
EOUCATION ft WELFARE 
NATIONAL INSTITUTE OF 
EOUCATION 

THIS DOCUMENT HAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIGIN- 
ATING IT POINTS OF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRE- 
SENT OFFICIAL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POLICY 



I 



2 



Effects of Teaching by Recitation on Learning 

Meredith D. Gall 1 , David C. Berliner, Leonard A. Cahen, 
Kenneth *A. Crown, Beatrice A. Ward 
Far West Laboratory for Educational Research and Development 

and 

2 

George C. Stanton and Philip Winne 
Stanford Center for Research and Development in Teaching 



f - INTRODUCTION 

This is a report of an experiment which was done to determine what student learn- 
ing outcomes are affected by variations in teachers' use of higher cognitive 
questions in classroom recitations. The classification of a question as "higher 
cognitive" was based on two criteria derived from Bloom's taxonomy of educational 
objectives in the cognitive domain (Bloom, 1956). First, a higher cognitive 
question requires the student to state predictions, solutions, explanations, evi- 
dence, generalizations, interpretations, or opinions. The second criterion is 
that the prediction, solution, etc. asked for in the question is not directly 
available in the curriculum materials; instead, the student is required to expand 
on or use in a new way information presented in the curriculum. Higher cognitive 
questions correspond to the Analysis, Synthesis, and Evaluation levels of Bloom's 
taxonomy. Questions which do not satisfy these requirements are classified as 
fact questions, corresponding to the Knowledge and Comprehension levels of Bloom's 
taxonomy. 

The experiment was designed to test the belief of many educators (for example, 
Sanders, 1966) that teacher use of higher cognitive questions is important for 
developing students ' ability to think. On this basis it was predicted that reci- 
tations with a high percentage of higher cognitive questions would promote more 
learning than recitations with a low percentage of these questions. 

Another purpore of the experiment was to determine the effects of presence versus 
absence of recitations on student learning. 

Review of Literature 

The correlational studies relating cognitive level* of teachers' questions to stu- 
dent learning were reviewed by Rosenshine (1971), who concluded that "no clear 
relationship has been found between the frequency with which the teacher uses cer- 
tain types of questions and the achievement of pupils... 11 (page 125). Further 
review and analysis by Heath and Nielsen (1973) indicates that the findings of 
these and similar studies are difficult to interpret because of flaws in research 
design. One problem is the limited range of student achievement measures which 
were used. For example, Wright and Nuthall (1970) found that the percentage of 
closed, that is, fact, questions was positively correlated kV*A6) with residual 
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student achievement scores, whereas the percentage of open, that is, higher cog- 
nitive, questions was negatively correlated (r=-.21) with the same criterion. The 
measure of student achievement was a multiple-choice fact recall test, which prob- 
ably is appropriate for measuring the effects of fact questions but not of higher 
cognitive questions. This problem is handled within the experiment reported here 
by including tests designed specifically to measure higher cognitive learning out- 
comes . 

Winne (1975) reviewed twelve experimental studies of teacher questions and found 
that "nine of them probably could not speak validly to the degree of influence 
that teacher questions have on student achievement . " One of the three studies 
which were methodologically sound (Buggey, 1971) found that higher cognitive 
questions lead to improved achievement relative to lower cognitive questions for 
second graders. However, this finding was not replicated by Savage (1972) in his 
experiment using fifth grade students. The third methodologically sound study, 
by Tyler (1971), found that questions framed by teachers are more effective than 
questions presented in text for second graders. 

The results of previous research on teachers' higher cognitive questions are not 
conclusive. The main implication of the review of literature is that further 
research characterized by rigorous methodology is needed. 



METHOD 



Treatments 

Hie common basis for the four experimental treatments was a specially designed 
ecology curriculum. The curriculum included ten lessons, each requiring an hour 
of class time, and taught at the rate of one per day. 

The curriculum materials were provided to all students, irrespective of treatment 
assignment, at the beginning of the class hour. The objectives of the curriculum 
were to provide students with information and ideas concerning balances that 
erist in nature; man's contribution to imbalances and to environmental pollution; 
and solutions to correct imbalances and pollution. The materials included a 
learning game, a film, two filmstrips, and text material for each lesson. 

Following viewing, and/or reading of materials at the start of each lesson, stu- 
dents formed into their assigned treatment groups. The four treatments are as 
follows: 

25% HCQ (Higher Cognitive Questions) Treatment . Specially trained ecology 
teachers'* conducted nine "semi-programmed 11 recitations, one for each of nine 
lessons. The recitations were programmed, that is, scripted in advance by the 
researchers, to insure uniformity of treatment across ecology teachers and to 
equate the opportunity to learn the curriculum content across treatment groups. 
Each recitation in each treatment consisted of sixteen questions. In the 25% 
HCQ treatment the recitations consisted of twelve fact questions and four higher 
cognitive questions. The questions pertained to the curriculum content which 
was included in the day's lesson. The ecology teachers probed and redirected 
students' answers to most of the questions. Since appropriate use of probing and 
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redirection techniques depends upon students' initial response to a question, 
this aspect of the recitations could not be scripted precisely (hence, "semi- 
programmed") . Instead, the ecology teachers were given guidelines concerning 
when and how often to use each technique. 

5 0% HCQ Treatment . In this treatment the recitations consisted of eight fact 
questions and eight higher cognitive questions. The eight fact questions were 
«*lected from the set of twelye fact questions in the 25% HCQ treatment.. The 
four higher cognitive questions of the 25% HCQ treatment also appeared in the 
50% HCQ treatment, plus an additional four higher cognitive questions. 

< 

75% HCQ Treatment . In this treatment the recitations consisted of four fact 
questions and twelve higher cognitive questions. The four fact questions and 
eight of the twelve higher cognitive questions were selected from the 50% HCQ 
treatment. 

Arc Activity Treatment , The students in this treatment participated in nine 
sessions of ecology-related art activities. The ecology teachers were instruc- 
ted not to ask any curriculum-related questions. 

Fidelity of Treatment 

Audiotapes of the three recitation treatments were made for two different lessons. 
Analysis of the audiotapes indicated high fidelity of treatment, that is, close 
correspondence between the recitation scripts and the teachers' actual behavior. 
Live observations of the Art Activity lessons indicated that the ecology teachers 
adhered closely to the requirements of this treatment. 

Experimental Design 

The four treatments— 25% HCQ, 50% HCQ, 75% HCQ, and Art Activity—were manipulated 
in a latin square design. The complete design is shown in Table 1. Multi-stage 
randomization procedures were used to assign schools and sixth-grade classrooms 
to latin square blocks, teachers to latin square blocks, treatments to teachers, 
and students to treatments. Basically, this procedure resulted in twelve repli- 
cations of each treatment. Each replication involved a group of students from a 
different classroom and a different ecology teacher. Each recitation group con- 
sisted of six students in order to make the recitation treatments comparable to 
another experiment being conducted by the researchers. Since there were three 
recitation groups in each classroom, a total of eighteen students were involved 
in recitation treatments. The remaining students in the classroom were assigned 
to the Art Activity treatment. 



MEASURES 

r 

Outcome measures were administered immediately before (pre), immediately after 
(post), or two weeks after (delayed) the treatments. 

Verbal Ability . Student's scores of verbal ability from the Comprehensive Tests 
of Basic Skills (CTBS, Form Q-Level 2) were made available by the participating 
school districts* Where appropriate, these scores were used to adjust students 9 
post and/or delayed scores on the other outcome measures. 



Infor matio n Test. This multiple-choice test was administered three times to each 
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student: pre, post, and delayed. It was designed to measure students' acquisi- 
tion of factual information in the ecology curriculum. The test consists of 
three subscales to measure intentional and incidental learning. Intentional 
Scale II contains eight items measuring students' ability to recall information 
covered in the recitation treatments. The 25% HCQ ' Incidental Scale II consists 
of seven items which were intentional only for students in the 25% HCQ treatments; 
the items were incidental for students in the other treatments. Incidental 
Scale II consists of ten items testing recall of information presented in the 
curriculum materials but not in any of the treatment variations. 

Oral Test . This individually administered test consists of six higher-cognitive 
questions L which students answered orally. It was given pre and post treatment 
to all students, and was designed to measure students' ability to give plausible, 
reasoned oral responses to higher cognitive 4 questions about the ecology curricu- 
lum. Since the nature of recitation is to elicit oral responses, it was thought 
that this test might be particularly sensitive to differences between the treat- 
ments in this experiment, for example, in the comparison of the recitation 
treatments with the Art Activity treatment. This test, like the Essay Test and 
Transfer Test described below, is scored on two scales: content (the number of, 
plausible solutions, predictions, explanations, etc., in response to the question) 
and Logical Extension (the number of rationales and if... then extensions in 
response to the question) . 

Essay Test . This test, administered pre and post treatment, consists of twelve 
higher cognitive questions for which students are to write brief essay answers. 
Similar to the Oral Test, the content of the Essay Test questions refers to the 
ecology curriculum. 

Transfer Test . This test, administered two weeks after completion of the treat- 
ments, consists of nine higher-cognitive questions for which students are to 
write brief essay answers. The purpose of this test was to determine whether 
higher cognitive response skills learned in the treatments would transfer to a 
new, unstudied curriculum topic — the problem of human population explosion. 

Word Association Scale . This set of scales, administered pre and post treatment, 
was developed to measure students' attitudes toward the major ecological topics 
taught in the ecology curriculum. The measure consists of six semantic differ- 
ential scales, each measuring students' attitudes toward a specific ecological 
topic through the use of ten bi-polar adjectives from Osgood's evaluative factor. 

Gall-Crown Discussion Attitude Scale . This measure, administered pre and delayed 
treatment, consists of two Likert-type subscales: one of nineteen items measur- 
ing students' attitude toward class discussions and one of eleve* items measuring 
students' attitudes toward teacher use of higher cognitive questions. 



RESULTS 



Data Analysis Plan 

The data in the latin square design were examined by analysis of variance methods. 
Each of the main factors — recitation treatment, classrooms, teachers, and squares — 
was considered as a fixed effect in partitioning the total variance into main 
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effects for treatments, classroom within squares, teachers within squares, squares, 
a treatment by square interaction, and a residual (error) term. Since the unit 
of analysis was the treatment group mean, the within group ..variance could not be 
used to provide an error term. The residual term was a pooled estimate of be- 
tween group variance composed of all the possible interaction terms except the 
estimable treatment by square interaction. 

In addition to examining the data for overall treatment differences, several .a 
priori questions pertaining to differences between treatment groups were of 
interest. The following planned comparisons of treatment differences were examined: 
(a) 25% HCQ versus 50% HCQ; (b) 50% HCQ versus 75% HCQ; (c) 25% HCQ versus 75% 
HCQ; and (d) the recitation treatments as a whole versus Art Activity. 

Each dependent variable was examined for the possibility of adjusting for pre- 
experimental differences before performing the analyses of variance. Dependent 
variables were adjusted when the correlation between the variable to be adjusted 
and the adjusting variable was greater than .30 and the usual assumptions for 
analysis of covariance were satisfied (Elashoff , 1969) . 

Presentation of Findings 

The results of all of the data analyses are summarized in Table 2 (measures of 
ability, achievement, and attendance^) and Table 3 (attitude scales). 

The leftmost column lists the names of the dependent variables. Each row of the 
table corresponding to the variable named presents information pertaining to that 
variable only. 

If the dependent variable was adjusted before the data were analyzed, the name of 
the adjusting variable appears in the column labeled "Adjusting Variable." The 
ifcajority of the adjusting variables are the pretreatment measures corresponding 
to the dependent variable, signified as "pre." Otherwise total reading score was 
generally the adjusting variable. 

The column labeled "MS error" presents the error mean square from the analysis of 
variance of cell means or adjusted cell means and its degree of freedom for each 
dependent variable. 

The next five columns list the F-statistics computed for the main effect of treat- 
ment, of class within squares, of teachers within squares, of squares and the 
treatment by square interaction, respectively. Also noted are the degrees of 
freedom associated with each effect. The critical value of the F-statistic at 
the five percent level of significance is presented in the footnote. F-statis- 
tics for dependent variables which are greater than the critical value are 
starred within the column to note statistical significance. The columns show 
the strength of association statistics associated with the column f s treatment 
effect. This statistic is interpreted as the percentage of variance in the 
dependent variable attributable to the treatment effect for that column. 

The next four columns present cell means for each treatment condition in the latin 
square design, that is, 25% HCQ, 50% HCQ, 75% HCQ, and Art Activity, respectively. 
For those variables which were adjusted before entry into the analysis of variance, 
these' values are adjusted cell means". A reference number in parentheses associated 
with each treatment is used in labeling the columns for planned comparisons. 
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The next fcur columns present F-statistics for the planned comparisons of treat- 
ment group means or adjusted means. The first of these columns compares 25% HCQ 
with 50% HCQ (1 vs. 2); the second contrasts 50% HCQ with 75%. HCQ (2 vs. 3); 
the third contrasts 25% HCQ with 75% HCQ (1 vs. 3). The next column compares 
the average effect of the three recitation treatments with the nonrecitation Art 
Activity treatment. Each of these planned comparisons has one degree of freedom 
and was tested using the error mean square from the analysis of variance. The 
critical value of the F-statistic for 1 and 17 degrees of freedom at the 5 per- 
cent level of significance is provided. F-statistics which are statistically 
significant at the 5 percent level are starred. In the column labeled "Prop/ 1 
the ratio of sum of squares for the contrast to sum of squares for the main 
effect of treatments is presented. This is a measure of the proportion of vari- 
ability among the four treatments accounted for by the difference between the 
mean of the recitation treatments and the non- recitation treatment. In other 
words, this ratio indexes the degree to which recitation was the contributing 
factor in the main effect for treatments. 

To assure that the results for various post and delay measures were not simply 
reflecting pre-existing differences among the sampled students, analyses of 
variance were performed on the total reading scores, i.e., the sum of vocabulary 
and comprehension subscale scores from the Comprehensive Tests of Basic Skills 
and on average number of lessons attended by students within a group. No effects 
significant at the 5 percent level were observed; the omega squared values were 
zero, with one exception. Similar results were obtained* for number of sessions 
held. It seems reasonable to conclude that differential absenteeism is unlikely 
to have been influential in producing the results observed in the table. 

Differences Between Recitation Treatments 

The planned comparison of the recitation treatment means show that percentage of 
higher cognitive questions was a statistically significant influence on the amount 
of information acquired by students as measured by subscales on the Ecology Infor- 
mation Test. The pattern of treatment mean scores is depicted inJFigure 1. It 
appears that a U curve describes the relation between percentage of higher cogni- 
tive questions and achievement on intentional and incidental scales of the Ecology 
Information Test. In all cases, the 50% HCQ treatment has considerably lower 
outcomes on the subscales of the Ecology Information Test than the other two 
discussion treatments. The 75% HCQ and 25% HCQ treatment outcomes fall at similar 
points for the various subtests. Outcomes for the art activity treatment approxi- 
mate those for the 50% HCQ treatment. 

The 25% HCQ treatment was superior to the other two recitation treatments on the 
25% HCQ Intentional Scale II. This finding is predictable, in that students in 
the 25% HCQ treatment had the advantage of answering (intentional) items which 
were^covered in the recitations of students in the 50% HCQ and 75% HCQ treatments. 

Hot + 

Two of the comparisons involving higher cognitive achievement measures were statis- 
tically significant. Students in the 50% HCQ treatment outperformed students in 
the 75% HCQ treatment on one of the Oral Test measures. They also outperformed 
students in the 25% HCQ treatment (statistically significant) and in the 75% HCQ 
treatment (approaching statistical significance) on one of the Essay Test measures. 

The mean scores of the recitation treatments on the attitude scales were quite 
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sirailar. Only one of the planned comparisons was statistically significant. 
Students in the 75% HCQ treatment expressed significantly more positive attitudes 
toward alli gator s than did students in the 50% HCQ treatment. 

Recitation Treatments versus Art Activity 

With one exception the mean scores of students in the combined recitation treat- 
ments were statistically greater than the mean scores of students in the Art 
Activity treatment on the Information Test measures. Also, the mean scores of 
students in the combined recitation treatments were statistically greater than 
the mean scores of students in the Art Activity treatments on three of the six 
higher cognitive achievement measures. The mean score of students in each reci- 
tation treatment was greater than the corresponding Art Activity treatment mean 
score for he three measures which did not reveal a statistically significant 
JHf ference. 

Planned comparisons involving the attitude measures revealed two significant 
differences. Students in the recitation treatments developed significantly more 
positive attitudes toward animals (wolves and alligators) presented in the 
curriculum than did students in the Art Activity treatment. Differences in 
scores on the other attitude scales, although not statistically significant, also 
generally favored the recitation treatments over the Art Activity treatment. 

Other Effects > 



Very few of the other effects in the analysis of variance — class, teacher, square, 
and treatment by square — were statistically significant. Omega squared values t 
were consistently small. 

As intended, the main effects attributable to ecology teachers were negligible. 
This result probably reflects the training given* to the ecology teachers in fol- 
lowing prescribed instructional patterns for each of the treatments. 



DISCUSSION 



The generalizability of the findings is limited by the fact that the experimental 
recitations were not representative of typical classroom teaching in two impor- 
tant respects. First, unlike the usual whole-class discussion, the experimental 
recitations were conducted in small groups of only six students'. Second, the 
ecology teachers taught from prescribed recitation plans developed by the re- 
searchers which were delivered in rigidly defined ways. Therefore, the results 
probably cannot be used to judge the effectiveness of the use of recitations by 
teachers in normal classrooms. In effect, the studies were designed to achieve 
high internal validity at the cost of limiting their generalizability. 



Within these above constraints on generalizability, it can be said that variation 
in the percentage of higher cognitive questions in recitations does affect 
learning. However, the effects are puzzling. Relative to .the 25% HCQ and 75% 
HCQ treatments, the 50% HCQ treatment was the least effective in promoting know- 
ledge acquisition and retention, but it was the most effective in promoting higher 
cognitive performance. Since the recitations of the 50% HCQ treatment did not 
, emphasize either fact or higher cognitive questions, it is possible that students 

were confused concerning the objective of the recitations — was the objective to 
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rehearse facts, or to think about them? To lessen their sense of confusion, 
some students may have decided to concentrate an answering teacher higher cog- 
nitive questions and ignored the fact questions, thereby causing a decrement in 
performance on the Information Test.' 

Generally students in the 25% HCQ treatment outperformed students in the 75Z HCQ 
treatment both on the knowledge acquisition and higher cognitive measures, 
although the absolute differences between mean scores were small. Contrary to 
the belief held by many educators, this finding suggests that an emphasis on 
fact questions rather than on higher cognitive questions is the more desirable 
teaching pattern. 

As expected, students in the 25% HCQ treatment answered correctly more of the 
Information Test items which were intentional for them, but incidental for stu- 
dents in the other two treatments. This finding suggests the generalization that 
if the teacher wants students to learn certain information in the curriculum, it 
is effective to rehearse that information by asking questions in recitation. 

One purpose for conducting the experiment was to determine the effects of presence 
versus absence of recitations on student learning. The findings clearly show 
that presence of recitations does have a significant positive effect. Recitations 
following initial viewing and/or reading curriculum materials make a contribution 
to learning beyond that produced by the initial viewing- reading experience. Spe- 
cifically/ recitations improve acquisition and retention of information and the 
ability to respond in written or oral form to higher-cognitive questions. Also, 
there is some evidence, although not as strong as for the above learning outcomes, 
that recitations can promote the development of positive attitudes toward the 
curriculum content. 

<* 
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, FOOTNOTES 

1 

The senior author is now affiliated with the University of Oregon, College of 
Education, Eugene, Oregon. 

? 

Dr. Philip Winne is now affiliated with Simon Fraser University, Faculty of 
Education, Burnaby, B.C., Canada. 

3 

This report is a summary of a larger report on this and another experiment. The 
other experiment used the same research design, teachers and curriculum as in 
this study. The treatments were different, though, because the experiment was 
designed to investigate the effects of teacher use of the recitation techniques 
of probing (asking the student a " follow-up ,f question to improve his initial 
answer ) and redirection (calling on more than one student to respond to a ques- 
tion). Another purpose of the experiment was^tfie Effects of teachers 1 questions 
delivered in recitation compared with the same questions presented and answered 
in written format. Three supplemental volumes present copies of the measures, 
curriculum and recitation materials, and item statistics. Requests for the full 
report and supplemental volumes should be sent to: Dr. Beatrice A. Ward, Far 
West Laboratory for Educational Research and Development, 1855 Folsom Street, San 
Francisco, CA 94103. 



The specially trained teachers are called "ecology teachers" in the report. 
These teachers were selected from substitute teacher rolls and trained by the 
researchers to conduct the treatments. The students' regular teacher did not 
participate in the experiment. 



Selected measures from the experiment are reported here. Measure* 1 of question- 
generating ability and attitudes toward the experimental conditions are described 
in the full report. 

The measure of attendance was the number of treatment sessions (possible range, 
0 - 10) at which each student was present. 
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